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Abstract 

Background: Early childhood immunizations, although vital for preventative health, are painful and too often lead 
to fear of needles. Effective pain management strategies during infant immunizations include breastfeeding, sweet 
solutions, and upright front-to-front holding. However, it is unknown how often these strategies are used in clinical 
practice. We aimed to review the content of YouTube videos showing infants being immunized to ascertain 
parents' and health care professionals' use of pain management strategies, as well as to assess infants' pain and 
distress. 

Methods: A systematic review of YouTube videos showing intramuscular injections in infants less than 12 months 
was completed using the search terms "baby injection" and "baby vaccine" to assess (1) the use of pain management 
strategies and (2) infant pain and distress. Pain was assessed by crying duration and pain scores using the FLACC 
(Face, Legs, Activity, Cry, Consolability) tool. 

Results: A total of 142 videos were included and coded by two trained individual viewers. Most infants received one 
injection (range of one to six). Almost all (94%) infants cried before or during the injections for a median of 33 seconds 
(IQR = 39), up to 146 seconds. FLACC scores during the immunizations were high, with a median of 10 (IQR = 3). No 
videos showed breastfeeding or the use of sucrose/sweet solutions during the injection(s), and only four (3%) videos 
showed the infants being held in a front-to-front position during the injections. Distraction using talking or singing was 
the most commonly used (66%) pain management strategy. 

Conclusions: YouTube videos of infants being immunized showed that infants were highly distressed during the 
procedures. There was no use of breastfeeding or sweet solutions and limited use of upright or front-to-front holding 
during the injections. This systematic review will be used as a baseline to evaluate the impact of future knowledge 
translation interventions using YouTube to improve pain management practices for infant immunizations. 
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Background 

Early childhood immunizations are essential for public 
health [1] however are painful, and often result in severe 
distress for infants and children [2,3]. They are also 
distressing for the parents [2,4-6]. Long-term risks of 
injections include fears of needle pain, parental non- 
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adherence with immunization administration and avoid- 
ance of medical care [2,4,7-9]. It is therefore vital that 
evidence-based strategies be used to reduce immunization 
pain. This is especially important for infants, as untreated 
or poorly treated procedural pain in early infancy can lead 
to altered pain responses [10,11], and contribute to im- 
paired brain development in preterm infants [12]. 

Extensive high quality evidence from large numbers of 
randomized controlled trials (RCTs) and systematic re- 
views demonstrate the analgesic effects of sweet solu- 
tions in newborn infants during commonly performed 
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painful procedures [13-15], and in older infants during 
immunizations [16,17]. There is also sufficient evidence 
of pain-reducing effects of breastfeeding during immuni- 
zations [18-21], front-to-front upright holding [22] and 
some evidence of distraction in infants, especially when 
led by nurses/other clinicians [23]. These strategies are 
included in pain management recommendations in the 
Clinical Practice Guideline (CPG) "Reducing the pain of 
childhood vaccination" published in the Canadian Med- 
ical Association Journal [3] by the Help Eliminate Pain 
in KIDS (HELPinKIDS) team, the Immunize Canada 
website (www.immunize.cpha.ca), and in immunization 
guidelines internationally [24]. Despite such published 
recommendations, studies of pain management practices 
during immunization show that these strategies are 
rarely used [4,7,25,26], highlighting a gap between rec- 
ommendations and clinical practice. In addition, when 
examining YouTube videos of infants being immunized, 
there is an abundance of videos showing a lack of 
utilization of pain management strategies. 

Social media currently plays a large part in the way 
people communicate, and health information is one of the 
most frequently sought topics on the Internet [27]. 
Launched in December 2005, YouTube accounts for 60 
percent of videos watched online [28] and the number of 
unique YouTube viewers per month is estimated at 136 
million, three times the number of the next most popular 
video web site [29]. With such growing popularity, it is 
evident that YouTube potentially provides a new way to 
communicate evidence-based health information to a large 
number of people. As early childhood immunizations are 
a priority health topic that parents may explore on the 
internet, we examined YouTube immunization videos in 
order to establish what pain management strategies are 
used and the degree of distress infants are exhibiting. 

In a previous review of YouTube immunization videos, 
25% of the retrieved videos pertained to childhood immu- 
nizations. Of these, almost half conveyed negative mes- 
sages about the painful nature of childhood immunizations 
[30]. However, to our knowledge, no studies have systemat- 
ically examined the content of YouTube videos relating to 
childhood immunization pain or pain management prac- 
tices. The purpose of this study was therefore to conduct a 
systematic review of YouTube videos showing infant im- 
munizations, to ascertain the use of pain management 
strategies, and to assess infants' pain and distress. This 
systematic review will be used as a baseline to evaluate 
the impact of knowledge translation interventions using 
YouTube to improve pain management practices. 

Methods 

Study design and screening 

Systematic review of YouTube videos of infants receiving 
immunization injections. 



Search strategy 

A preparatory review of YouTube search and review 
methods was done to inform decisions around the 
search and screening, such as screening order and dis- 
continuation criteria [31]. In July 2012, and January 
2013, a search of YouTube videos was completed using 
the default settings for the terms "baby injection" and 
"baby vaccine" as these were the two terms with the 
highest proportion of web searches, based on Google 
Trends [32]. The search and screening flow is shown in 
Figure 1. 

A new YouTube account was used to eliminate the 
chance of search history influencing search rankings. 
The end point was determined through a discontinu- 
ation rule of 20 videos. When 20 consecutive videos did 
not meet eligibility criteria and were excluded, no fur- 
ther videos were screened. After viewing a video that fit 
the inclusion criteria, the researcher screened the first 
five related suggested videos that appeared [31]. 

As we aimed to review pain management practices 
used in actual clinical practice, we did not include edu- 
cational videos or company/institution videos. Inclusion 
criteria included YouTube videos with English titles, 
available audio, portraying human infants 0 to 12 months 
of age (as assessed by the researcher) and showing at 
least one intramuscular injection. Videos that were edu- 
cational or informational in nature were excluded. 

Data collection 

Data collected for each included video comprised date of 
upload, number of views, age of infant (approximately 0, 
2, 4, 6 or 12 months, as assessed by researcher), sex of 
infant (as per the data collectors judgment), number of 
injections, sex of main caregiver in the video, as well as 
the number of other people in the room, their sex and 
approximate age (child or adult), and the number of 
comments on each video. The first ten comments for 
each video were screened and classified into three cat- 
egories: emotional, informational, or irrelevant. Lastly, 
YouTube allows viewers the option to click a "like" or 
"dislike" button to express their opinion on a video; the 
total number of "likes" and "dislikes" recorded under- 
neath each video was recorded. 

Each video was viewed for observable pain manage- 
ment strategies used during and after the injection. This 
included pharmacological, physical, and psychological 
strategies, such as topical anesthetics, positioning, dis- 
traction, breastfeeding, and the use of sweet solutions or 
sweet foods. To assess the infants' pain and distress, we 
included crying incidence before and during the proced- 
ure, measured crying duration in seconds, and rated pain 
using the FLACC (Face, Legs, Activity, Cry, Consolability) 
tool [33]. The FLACC comprises 5 components, each 
with a possible value of 0 to 2, for a maximum total 
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N = 3 554 (baby injection) 4 
N = 2 287 (baby vaccine) 



Videos screened 
n = 5 841 




Videos excluded by 
discontinuation rule 
(n = 5 496) 





Videos assessed for 
eligibility 
(n = 345) 



Videos excluded, with 
reasons 
n = 1 (non-English title) 
n = 22 (non-IM injection) 
n = 5 (non-Human) 
n = 22 (non-Infant) 
n = 153 (off Topic) 
n = 203 (total) 



Included Videos 
N= 142 



Figure 1 PRISMA diagram. 



FLACC score of 10 indicating maximum pain. A pri- 
mary coder completed FLACC scores on all included 
videos from the two searches in July 2012 and January 
2013. To establish inter-rater agreement of FLACC scores 
for this project, we had a secondary coder inde- 
pendently view and score the first 92 (65%) videos in- 
cluded. Both coders were experienced pediatric nurses 
who received training on the FLACC scale. 

Data analysis 

IBM SPSS [34] was used for all statistical analyses. De- 
scriptive data are presented as means and standard devi- 
ations if normally distributed and presented as medians 
and interquartile ranges if non-normally distributed. 
Agreement between two individual coders on FLACC 
scores was assessed using intraclass correlation coeffi- 
cient (ICC). If any one of the five components of a 
FLACC score was missing, the score was included and 
data was imputed using the calculation - (FLACC score/ 
4) X 5. If two or more components were missing, the 
score for that time point was omitted from analysis. 



Ethics 

This study was approved by the Children's Hospital 
of Eastern Ontario (CHEO) Research Ethics Board in 
Ottawa, Canada (protocol #13/02X). 

Results 

A total of 142 videos were included in the systematic re- 
view. The oldest included video was posted in February 
2006. The median length of the videos was 74.5 seconds 
(IQR = 68, min = 10, max = 595) and the median number 
of views was 2,001 (IQR = 19,601, min = 1, max = 
302,103). The included videos had a median of 1 like 
(IQR = 5, min = 0, max = 63) and a median of 0 dislikes 
(IQR = 1, min = 0, max = 42) at the time of initial view- 
ing. The videos had a median of 1 comment (IQR = 7, 
min = 0, max = 476). Just over half (N = 78, 55%) of the 
videos were of infants receiving their 2-month immuni- 
zations. The majority of the caregivers were female 
(N = 97, 69%), while 28 (20%) were male and 16 (11%) 
were not visible at any time during the immunization 
video. In 38 (27%) videos, another adult and/or child 
were visible in the room. Seventy-six (54%) infants 
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received one injection (median = 1, IQR = 1) with the 
number of injections ranging from one to six. The me- 
dian length of procedure, defined as the time when 
the first injection site is cleansed to the time the last 
bandage or cotton swab is applied, was 34 seconds 
(IQR = 39), with a maximum of 256 seconds. 

Pain management strategies during immunizations 
were evident in 72.5% of the videos. No videos showed 
use of breastfeeding, sucrose or other sweet solutions, or 
topical anesthetics. Eighty-eight (62%) infants were laid 
flat on their back during immunization and only four (3%) 
videos showed use of front-to-front upright holding. The 
most common pain management strategy observed was 
some form of distraction, with 66% of caregivers using 
singing or talking and 6% using a toy (Table 1). 

A total of 120 videos were assessed for pain manage- 
ment strategies after the completion of the injection. 
The remaining 22 videos ended immediately after the 
completion of the injection and were therefore excluded 
from this part of the analysis as pain management strat- 
egies after the immunization could not be assessed. Of 
the 120 videos, at least one observable pain management 
strategy post-immunization was evident in 96 (80%) vid- 
eos. Distraction was the most common strategy used, 
with 80% of caregivers using singing or talking and 7% 
using a toy. Thirty-four (28%) videos showed front to 
front upright holding and 13 (9%) videos showed non- 
nutritive sucking after the immunization (Table 2). 

Fourteen (10%) videos showed infants crying before 
the procedure; all 14 of these infants continued to cry 
during the procedure. A total of 134 (94.4%) videos 
showed infants crying during the procedure. Of the 134 
infants who cried, the median total cry time was 33 sec- 
onds (IQR = 39), with a maximum of 146 seconds. 

Table 1 Observable pain management strategies used 



during immunization 

Strategy (n = 142) N (%) 

Distraction using singing or tall<ing* 93 (65.5) 

Tall<ing only 92 (64.8) 

Singing and tall<ing 1 (0.7) 

Holding (any position) 54 (38) 

Front-to-front 4 (2.8) 

Front-to-back 21 (14.8) 

Front-to-side 28 (19.7) 

Combination of positions 1 (0.7) 

Non-nutritive sucking 1 1 (7.7) 

Distraction using any toy 9 (6.3) 

Noisy toy 2(1.4) 

Silent toy 7 (4.9) 

Rubbing at injection site 8 (5.6) 



*2 missing - could not distinguish If singing or talking was used. 



Table 2 Observable pain management strategies used 



post immunization 

Strategy (n = 120) N (%) 

Distraction using singing or talking* 94 (79.7) 

Talking only 90 (76.3) 

Singing and talking 4 (3.4) 

Holding (any position) 65 (54.2) 

Front-to-front 34 (28.3) 

Front-to-back 7 (5.8) 

Front-to-side 21 (17.5) 

Combination of positions 3 (2.5) 

Non-nutritive sucking 13 (9.2) 

Distraction using any toy 10 (7.0) 

Noisy toy 4 (2.8) 

Silent toy 6 (4.2) 



*2 missing - could not distinguish if singing or talking was used. 

Infants' pain during the immunizations was coded 
using the FLACC scores at four different time points: 
baseline (15 seconds before the first injection), at the 
time of the first injection, at the time of the last 
injection, and 15 seconds following the last injection 
(Figure 2). A total of 16 (11.3%) FLACC scores were im- 
puted at baseline, 19 (13.4%) at time of first injection, 6 
(4.25%) at time of last injection, and 27 (21.1%) fifteen sec- 
onds after the last injection. The most common missing 
component of the FLACC score at each time point was 
legs, followed by face. At baseline, the median FLACC 
score was 0 (n = 116, IQR = 0). During the injections, the 
majority of infants' FLACC scores were the maximum 
score of 10. At the time of the first (n = 134, IQR = 3) and 
last injection (n = 61, IQR = 0) both median FLACC 
scores were 10, and the median FLACC score 15 seconds 
after the last injection was 7 (n = 107, IQR = 6.25) 
(Figure 2). The median FLACC scores of 10 at the time 
of first and last injection indicate high levels of pain. 

Inter-rater agreement of the FLACC tool for the first 
92 videos included (65% of all included videos) was 
established by two trained independent raters. Intraclass 
correlation coefficients (ICC) were 0.81 at baseline, 0.77 
at time of first injection, and 0.76 at 15 seconds after the 
last injection, indicating acceptable agreement (Table 3). 

Discussion 

To our knowledge, this is the first systematic review of 
videos posted on YouTube of infants undergoing 
immunization. The reasons for which parents post such 
videos of their infants undergoing immunizations are 
not known, and we did not seek to uncover motives for 
these posts. We aimed to conduct a systematic review of 
YouTube videos to gather evidence on the use of recom- 
mended pain management strategies, and to conduct 
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□ 0 (Relaxed and comfortable) 

□ 1-3 (Mild discomfort) 

■ 4-6 (Moderate pain) 

■ 7-10 (Severe discomfort/ijain) 



Baseline At time of first At time of last 15 seconds 
injection injection after last 
injection 



Figure 2 FLACC scores. 



pain assessments using crying duration and FLACC, the 
composite validated pain assessment tool We found that 
most infants were highly distressed during the injections. 
This is disappointing given that strong evidence clearly 
shows the pain-reducing effects of breastfeeding infants 
[18-20,35], sweet solutions [17,36], using nurse/clin- 
ician-led distraction and upright holding [3,22,23] and 
given the work that has gone into translating this know- 
ledge to the public and health care profession [3,37]. It 
is however possible that the pain control measures ap- 
parent during vaccinations as seen in the posted videos 
are not representative of all vaccinations, as the act of 
videotaping precludes holding the infant, breastfeeding 
or administering sucrose unless a tripod or third party is 
available to operate the camera. However, the observed 
infrequent use of recommended pain management strat- 
egies are concordant with results of published surveys of 
health care professionals' pain management practices 
during immunization [4,7,25,26] as well as a recent ob- 
servational study of pain management practices in in- 
fants during immunization [38]. This highlights that, so 
far, current evidence and guidelines relating to pain 
management strategies, most of which has been available 
prior to the date of the first YouTube posting, have been 
unsuccessful in changing immunization pain practices. It 
is not known whether this is an issue of reach, and 
therefore a lack of knowledge concerning best pain 
management practices, or whether this information is 
known, but not used by the multitude of different groups 
of immunizers and parents of infants. However, it is 

Table 3 Inter-rater reliability 



Time point 


N 


ICC 


95% CI 


Baseline 


70 


0.809 


0.709-0.877 


At time of first injection 


85 


0.774 


0.672-0.847 


15 seconds after last injection 


79 


0.756 


0.643-0.837 



impossible to know when parents produced the videos 
and it is possible that some of the videos were filmed 
prior to the publication and dissemination of recom- 
mended evidence-based pain management practices. 
Regardless, a state of play exists currently where infor- 
mation is known, but is inconsistently used in clinical 
practice [4,7,25,26,38]. 

Taddio et al. attributed suboptimal pain management 
during childhood immunization to lack of parental 
knowledge about pain, health care professional attitudes 
to pain severity and effective pain management, and 
societal attitudes about pain including dismissing the 
impact of needle pain [4]. Taddio et al. also presented 
a number of myths concerning barriers to using ef- 
fective pain management strategies for infants. Myths 
concerning using breastfeeding for pain management 
include beliefs that the infants will choke, or associate 
the mother with pain and myths concerning sucrose 
include interfering with breastfeeding and damaging 
infants' teeth. Myths concerning the need to provide 
pain management strategies include that infants cry 
anyway; they need to cope with pain; and they get 
used to shots (Pages S160- S161 [4]). Pillai-Riddel et al. 
suggests that despite the knowledge health care profes- 
sionals have about short-term pain and distress-reducing 
benefits of strategies such as breastfeeding and sweet solu- 
tions, they may not believe that putting these pain- 
reducing strategies into place is a clinical priority, as there 
is little known about the long term benefits of reducing 
childhood immunization pain [39]. This belief exists in 
the face of clear and extensive descriptions about high 
levels of distress infants exhibit during immunizations 
[38,40] and the fact that parents may avoid having their 
children immunized due to concerns about pain [9]. Add- 
itional barriers may be due to availability of commercially 
manufactured sucrose in diverse settings where immuni- 
zations take place and no knowledge to make home-made 
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sucrose; cost factors such as purchase cost of topical anes- 
thetics; organizational factors such as privacy for breast- 
feeding, or perceived increased ease of vaccinating if the 
infant is lying on an examination table as opposed to be- 
ing held. 

Although our findings of high levels of distress may be 
influenced by the proportionally larger number of videos 
showing 2-month old infants, who may exhibit higher 
levels of distress than older infants [41], infants of 
all ages can become distressed during immunizations 
[38,40]. There is a high prevalence of fear of needles in 
children, which could likely have developed as a result of 
the painful injections in infancy [2,4,7,8,42]. These con- 
cerning factors highlight the need for health care profes- 
sionals and parents of infants and young children to 
work together to reduce the pain of childhood vaccina- 
tions. Although our results, consistent with previous 
research, show that parental talking, singing and reassur- 
ance, is commonly used (for example, talking or singing 
was observed in 66% the videos), and most parents in- 
stinctively use reassurance, this has been shown to lead 
to higher exhibition of pain behaviors [38]. This may 
also account for the high levels of distress as observed in 
the majority of infants in this study, highlighting that 
health care professionals need to support parents to pro- 
vide effective pain management strategies. 

YouTube may be a promising medium for disseminat- 
ing knowledge to health care professionals and parents. 
The YouTube website attracts over 2 billion views daily 
[43], and its use as a knowledge translation forum for re- 
searchers and health professionals is growing in popular- 
ity. In this systematic review of YouTube videos of 
infant immunizations, we used YouTube as the source 
of information to study - i.e., the participants' are 
the posted YouTube videos. Other topics relating to 
pediatric health care that have been researched using 
YouTube include information on the management of 
burn injuries [43], information on tonsillectomy [44], 
and dental fear and anxiety [45]. Topics researched using 
YouTube in adults include concussion [46], inflamma- 
tory bowel disease [47] and anorexia [48]. To facilitate 
the use of YouTube as an information source, Sampson 
et al. published a review on the methods used to under- 
take reviews of YouTube [31,49]. 

One example of health care professionals using You- 
Tube as a medium for information sharing with con- 
sumers is the Canadian Institutes of Health Research 
(CIHR) funded HELPinKIDS teams utilization of You- 
Tube for disseminating knowledge about effective pain 
management strategies for infants during childhood 
immunizations. In 2012 the team posted a comprehen- 
sive educational YouTube video discussing a variety 
of pain management strategies, including the use of 
breastfeeding, sucrose and secure front-to-front holding 



(HELPinKIDS Managing Infant Pain https://www.you- 
tube.com/watch?v=jxnDc2PxGUc&list=PLJH3y0duq2ZE 
Q_Kkfl<Vl<cLwZUk3HPV6xj&index=l). The video is over 
8 minutes in duration, considerably longer than the typ- 
ical videos posted on YouTube by parents. Since posting 
to YouTube in November 2012, the video had 4,869 hits 
in 12 months (as of November, 13, 2013). The impact of 
this teaching video is not yet known. However, com- 
pared to some other YouTube videos showing infants 
vigorously crying during their injections, the HELPin- 
KIDS educational video has had much fewer hits, 
highlighting that attention seems to be drawn to the 
consumer posted videos showing crying infants, rather 
than the instructional video highlighting how to reduce 
pain during immunizations. This highlights the need for 
health care professionals and researchers wishing to 
utilize YouTube as a knowledge translation and dissem- 
ination tool to understand the most effective ways to en- 
sure popularity, when practice change is a goal. 

Limitations 

There are several limitations to this study. Consumers 
posted all videos with no pre-set standards for rigor or 
quality. A systematic review of such varying quality vid- 
eos is therefore acknowledged to be less rigorous than a 
systematic review of published RCTs. Not all videos were 
of sufficient quality for analysis. For example, in 26 vid- 
eos, we were not able to sufficiently see the infants to 
determine FLACC scores at baseline, and, in eight vid- 
eos, we could not determine FLACC scores at the time 
of first injection. In 22 cases, pain management strat- 
egies used after completion of the injection could not be 
visualized due to the video footage ending as soon as the 
injections were completed. Furthermore, it was often 
impossible to determine if the vaccine administration 
technique and the order of vaccine administration was 
in accordance with current recommended guidelines 
(i.e. rapid injection technique with no aspiration and 
most painful injection administered last) [3], which are 
known to impact pain responses [50,51]. In addition, 
as stated above, it is impossible to know when the videos 
were filmed, and it is possible that some videos may have 
been produced years prior to the availability of knowledge 
translation products and recommended evidence-based 
pain management practices. 

Another limitation in conducting a systematic review 
of consumer posted videos on YouTube relates to the 
risk of posting' bias. The pain management strategies 
used in the reviewed videos may not be representative of 
all vaccinations for two reasons. First, as previously 
discussed, the act of videotaping precludes the use of 
pain management strategies such as holding the infant, 
breastfeeding or administering sucrose unless a tripod or 
third party is available to operate the camera. Second, 
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caregivers who used pain management strategies, most 
notably breastfeeding, may not be comfortable choosing 
to have the procedure video recorded and posted publicly. 

Conclusions 

In conclusion, this systematic review of 142 YouTube 
videos showing infants being immunized highlights that 
most infants were highly distressed during the injections; 
there was no evidence of use of breastfeeding or sweet 
solutions and infants were rarely securely held in an up- 
right front-to-front position. This systematic review of 
YouTube videos of infant immunization will be used as 
a baseline to evaluate the impact of a knowledge transla- 
tion intervention using YouTube, aimed at improving 
pain management practices. 
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